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STATEMENT OF FACTS 

1. The person making this declaration represents outside counsel 
retained by the inventors of the subject matter claimed in the instant application. 
Outside counsel prepared and filed the Instant application. Furthermore, the 
person making this declaration is the individual who directly supervised the patent 
agent who drafted the instant application. The patent agent who drafted the 
instant application is no longer employed by outside counsel. 

2. Outside counsel prepared the instant application from at least just 
before September 19, 2001 to its filing on December 13, 2001. 

3. At the time outside counsel began preparing the patent application, 
Inventor Sanders was the only known inventor, though Inventor Nguyen and 
Inventor Pascarella were his co-workers who jointly invented the claimed 
invention. The unintentional omission of the other true inventors was discovered 
by Applicants' in-house counsel in approximately the beginning of February 2002, 
after the application had been filed. At that time, Inventor Nguyen and Inventor 
Pascarella were added in accordance with the M.P.E.P. procedures. For this 
reason, Inventor Nguyen and Inventor Pascarella were not substantively involved 
in the preparation of the instant application, but since being added, have 
cooperated in the further prosecution of the instant application. 

4. The following attached documents are submitted as evidence to 
establish diligence by outside counsel from at least just before September 19, 
2001 to December 13, 2001 in preparing and filing the instant patent applicafion: 

a. Exhibit Harris 1 attached hereto is a true and correct copy of 
disclosure notes prepared and used prior to September 19, 2001 by outside 
counsel in preparing the instant patent application. The disclosure notes are 
based on a recording of inventor Sanders disclosing the subject matter of the 
instant application prior to September 19, 2001. The disclosure notes are 
accompanied by a screen shot of an electronic document management system 



172171.01/1662.39100 



Page 2 of 5 



HP PDNO 200304298-1 



Serial No.: 10/017,785 
Filing Date: 12/13/2001 



log pertaining to these notes, thereby establishing reasonable diligence by 
outside patent counsel in preparing and filing the instant patent application. The 
screen shot is obtained from an electronic docunnent management system used 
by outside counsel to prepare the instant patent application, and reflects dates 
indicating the outside counsel prepared and saved the disclosure notes prior to 
September 19, 2001. The notes and screen shot of Exhibit Harris 1 support that 
work on the application was in progress at least just before September 19, 2001. 

b. Exhibit Harris 2 attached hereto is a true and correct copy of 
a report generated by an electronic time keeping program establishing reasonable 
diligence by outside counsel in preparing and filing the instant patent application. 
The report shows that, prior to September 19, 2001, outside counsel began 
preparing the instant application, and diligently continued work on the instant 
application, with the exception of periods of time during which inventor Sanders 
was unavailable for review and comment due to his hospitalization and steadily 
declining health until his death in late 2001. As previously noted, Inventors 
Nguyen and Pascarella had not yet been discovered and identified as inventors 
during the time that the application was being prepared, and thus were not 
involved. 

c. Exhibit Harris 3 attached hereto is a true and correct copy of 
a screen shot of an electronic document management log establishing reasonable 
diligence by outside counsel in preparing and filing the instant patent application. 
The screen shot is obtained from an electronic document management system 
used by outside counsel to prepare the instant patent application. The screen 
shot shows that work began and continued in the instant application from at least 
just before September 19, 2001 until the filing of the instant application on 
December 13, 2001, with the exception of periods of time during which inventor 
Sanders was unavailable for review and comment due to his hospitalization and 
steadily declining health until his death in late 2001. 

d. Exhibit Harris 4 attached hereto is a true and correct copy of 
an initial draft of the instant application sent via email from outside counsel to 
inventor prior to September 19, 2001. 
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e. Exhibit Harris 5 attached hereto is a true and correct copy of 
a note to file from outside counsel confirming that the initial draft of the instant 
application (Exhibit Harris 4) was sent from outside counsel to inventor Sanders 
on Saturday (/.e., the date on which the draft was sent was a Saturday prior to 
September 19. 2001). 

f. Exhibit Harris 6 attached hereto is a true and correct copy of 
internal email communication of outside counsel indicating that progress on the 
instant application between at least just before September 19, 2001 and 
December 13, 2001, was slowed by Inventor Sander's hospitalization, poor health, 
and ultimately his death in late 2001. Outside counsel contacted him regarding 
further revisions to the patent application as often as deemed appropriate, given 
that Inventor Sanders was dying of cancer and was in and out of the hospital 
during the fall of 2001. 

g. Exhibit Harris 7 attached hereto is a true and correct copy of 
internal email communication of outside counsel indicating that progress on the 
instant application between at least just before September 19, 2001 and 
December 13, 2001, was slowed by Inventor Sander's hospitalization, poor health, 
and ultimately his death in late 2001. Outside counsel contacted him regarding 
further revisions to the patent application as often as deemed appropriate, given 
that Inventor Sanders was dying of cancer and was in and out of the hospital 
during the fall of 2001. 

h. When it became clear that Inventor Sander's health 
problems, which ultimately resulted in his death, precluded him from further 
participation in preparing the application, the instant application was filed 
December 13, 2001. 

i. After filing the Instant application, the unintentional omission 
of Inventor John Nguyen and Inventor Randall Pascarella was discovered by 
Applicants' in-house counsel, and appropriately remedied by outside counsel. As 
noted above, Inventor Nguyen and Inventor Pascarella did not, for this reason, 
participate in preparation of the instant application since their involvement as 
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inventors was not yet discovered; however, since being added, each has 
participated in prosecution of the instant application. 

5. I hereby declare that all statements made herein are true; that these 
statements are made from my own knowledge; that these statements are made 
with knowledge that willful false statements and the like are punishable by fine, 
imprisonment, or both, under Section 1001 of Title 18 of the United States Code; 
and that willful false statements may jeopardize the validity of the application or 
any patent issued thereon. 



Respectfully submitted, 





PTO Reg. No. 44,144 
CONLEY ROSE, P.C. 



(713) 238-8000 (Phone) 
(713) 238-8008 (Fax) 
ATTORNEY FOR APPLICANTS 



172171.01/1662.39100 



Page 5 of 5 



HP PDNO 200304298-1 



Redundant data/power infrastructure - 39100 

Three years ago. Disclosure 98-2403, Central Management Bus not to be submitted. 
Instead, disclose redundant data and power infrastructure for modular devices in a rack. 
Each server has a redundant set of connections to a pair of aggregators (switches) and 
redundant power fields. Switches can be daisy chained together to connect chassis of 
servers together. Each chassis has up to 6 servers. 

Problem: How do I deploy large numbers of servers quickly and reliably?? 2 big issues: 
mechanically, how do I get them in and out quickly for servicing? How do I eliminate 
the wiring. Wiring takes the most amount of time. Can come up with a mechanical 
package for sliding servers in and out, but how do I eliminate wiring? Infrastructure for 
Cable Elimination (ICE). 

First looked at lU servers. Minimum 2 hot plug drives out the front. Smallest face plate 
that accommodates this. 8 slots (servers), 16 drives in the face. 2 switches on sides. 
Backplane does the cabling for all of these. Backplane is a thick pc board. Power 
backplane has electronic ftises. Prevents a shorted out server from blowing the whole 
system. Only shuts power to that slot. Power distribution is through backplane. 75 amps 
of power. 

2 separate infrastructures. Set of cabling & backplanes for signaling & management bus. 
Ethemet (Intemet Protocol) now. Eventually mixed or infiniband. Switches on the end 
can convert to ethemet if we want infmiband internally. IB is a good way of coimecting 
drive structures. Now, hard SCSI connect. Cables are bulky. Fibre channel is another 
option, but there is no standard, so couldn't offer something that works with everything. 

IB is standard across platforms. Block level access, memory access, q-pairs (allows you 
to associate areas on the network), SAN. Ethemet has high latency. Want to support 
scaling of processing systems. 

Invention is the concept of interconnecting servers (fabric), which is heretofore 
undefined. Invention imposes a structure on this that is flexible enough to allow a 
customer build as he wants, but permits "pre-wiring" and mechanical interface. Can pre- 
wire systems, but at least a few customers will still need to reconfigure because of their 
particular application. This system is generic and should be usable by all. Less weight, 
time, service. 

Major components, icebox (8 slots for servers blades, 2 switch blades). Redundancy over 
all power and signals. High reliability. Dual pathways. Preferably uses one and flips to 
the other if there is a failure. May alternatively transmit over both simultaneously. If one 
is lost, we just lose bandwidth. 

For every server blade, both signals and power go in each direction to both switches. 
Multiple coimections in each direction. Hand drawn sketch. 



Some conventional racks include a single switch feeding all servers and or subsequent 
switches. More of a pyramid scheme. Can't build racks this way because we don't know 
what people want. 

Customer can still implement with the preferred embodiment, but can now interconnect 
with very short cables. 

With infiniband, switches are infiniband connections may be used with disk drives, SAN, 
etc... 

Permits online server spares. Can automatically switch to a new server if one goes down. 

Power Supply: A & B Through busbar, out of each side 400 amps, 48 V. Connected 
through a switch breaker built into bus bar into power backplane. Power infrastructure is 
redundant as well. A & B can be off different AC circuit so even if an AC main is lost, 
still have power. 

Each icebox has a 75 amp breaker. Each slot has an electronic breaker. Management 
network for each rack to automatically tum power on or off. Knows order of chassis #, 
slot#. Freon network orders the boxes, top to bottom. Rack name is arbitrary. Even 
power chassis has slots (6). 2 bus bars, each chassis has an A & B. Power backplane 
connects to each bus bar. Can draw power from one, the other, or from both. A & B 
capable of running the entire rack. Each can provide 1800 W. Customer can elect to 
prioritize servers to maintain redimdancy if power goes down. DISA distributed internet 
server architecture. Tum off front end servers. 

Pass through cable or in baclq)lane. 

Modular to the point where we can replace blades, backplanes, or chassis. 
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Express Mail Label No. 

REDUNDANT DATA AND POWER INFRASTRUCTURE FOR 
MODULAR SERVER COMPONENTS IN A RACK 

CROSS-REFERENCE TO RELATED APPLICATIONS 
[0001] Not applicable. 

STATEMENT REGARDING FEDERALLY SPONSORED 
RESEARCH OR DEVELOPMENT 

[00021 NotappUcable. 

BACKGROUND OF THE INVENTION 

Field of the Invention 

[0003] The present invention generally relates to rack mounted computer servers. More 
specifically, the preferred embodiment relates to data and power distribution between and among 
servers within a rack system. More particularly still, the preferred embodiments of the present 
invmtion relate to a modular infrastructure for distributing redundant powa: and data in a rack 
system. 

Background of the Invention 

[0004] Conventional rack mount servers provide a flexible and effective way of providing 
varying levels of computing power in a relatively small volume. Within a single rack, multiple 
servers may be coupled together to perform Common tasks. In addition, servers of dififCTent sizes 
may be installed in a rack to provide different levels of storage or processing capacity. Adding to 
this flexibiUty is the fact that the size of racks and servers are rather standardized. Many 
conventional racks comply with the EIA (Electronic Industries Alliance) standard 19 inch width 
for server and laboratory equipment racks. In addition to this width standard, many conventional 
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rack mount servers also comply with the a unit height ('TJ") standard of 1.75 inch. Thus, a lU 
server has a height of 1 .75 inch while a 4U server is 7 inches high. Thus, servers of different sizes 
may be installed in different combinations within a server rack to provide a fiilly tailored system. 
[0005] Unfortunately, along with this expandability comes the complexity of deploying a fiilly 
configurable system. The interconnection fabric for conventional rack mounted server networks is 
system dependent and must be developed from scratch. With conventional rack systems, multiple 
cables must be connected to each server for data, power, system management and any other device 
dependent connections. A typical deployment involves dozens of power and data cables that must 
be routed and neatly bundled to prevent cross-talk or other interference. It can literally take hours 
to wire up and deploy a single rack. Deploying multiple racks adds to the complexity because 
cables are needed for every server in every rack. 

[0006] If sj^tem administrators wish to combine servers in separate racks into a conmion 
network, a switch or hub must be incorporated in the racks to transmit data between racks and 
among servers within a rack. This once again adds to the complexity of the system as provisions 
must be made for space and wiring of the switch/hub. Unless these provisions are made ahead of 
time, an existing network must be modified. Unfortunately, modification of a network of rack 
servers is complicated by the fact that cables often need rerouting and rebundling. This example is 
just one of many showing how deployment of a network of conventional rack mounted servers 
requires extensive planning and forethought. Conventional rack server networks are simply not 
easily deployed or modified. 

[0007] Another problem with conventional systems arises when an individual server needs to be 
replaced. In large network applications such as with service providers, it is not uncommon for 
multiple racks to sit side by side, lining the walls of entu-e rooms. In this scenario, access to the 
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rear of any individual rack is limited To disconnect and remove a single server, the entire rack 
must be pulled out or positioned to access the rear of the server and the correct cables must be 
located and disconnected. As one can see, replacing a single rack moimted server can be 
inconvenient and time consuming. 

[0008] In li^t of these issues, it would therefore be desirable to provide an infrastructure for 
rack mounted server components that eliminates much of the cabling that is required in 
conventional systems. The novel infrastructure would advantageously decrease the amount of time 
required to deploy a rack of servers, hi addition,, the improved mefliod would facilitate the rapid 
replacement of individual severs within a rack. 

BRIEF SUMMARY OF THE INVENTION 
[0009] The problems noted above are solved in large part by a computer server rack, comprising 
a pluraUty of modular server chassis, each chassis configured to hold a plurality of servers and at 
least one data aggregator. Each server is preferably enclosed in a housing called a server blade. 
The data aggregator, which is preferably implemrated as an efhemet network switch, is coupled to 
each server in the same chassis via a point to point link. The data aggregator may also be 
implemented using an hifiniband network switch. The point to point link is preferably 
encapsulated in a data backplane. Individual servers in a chassis are coupled to a network by 
coupling the aggregator in the same rack to the network. Preferably, each chassis includes at least 
a second aggregator coupled to each server in the same chassis. This second aggregator is coupled 
to each server in the chassis via a redundant copy of the same point to point link that exists 
between the first aggregator and each server in the same chassis. 

[0010] Each rack also comprises at least one group of AC to DC power suppKes. The rack 
fiarther includes a power bus bar configured to transmit power fix>m the power supplies to a power 
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backplane in each servo- chassis. DC power is provided to each server in the rack through the 
power bus bar and through the power backplane located in the same chassis. A redundant second 
group of AC to DC powCT supplies are also configured to transmit power to the power baclq)lane in 
each server chassis throu^ the power bus bar. Power from each group of power suppKes is 
transmitted to a separate power transmission line in the bus bar. In this manner, DC power from 
both the first and the second groups of AC to DC power supplies is provided to each server in the 
rack through the power bus bar and the power backplane located within the same chassis. A power 
connector at the rear of each server blade enclosure mates with a mating power connector on the 
power backplane. The power backplane also includes a fuse between the power supply and each 
device slot. 

[0011] For data transmissions, a data connector at the rear of each server blade enclosure mates 
with a mating server data connector on the data backplane. Each switch also couples to the data 
backplane with mating data connectors. The point to point links in the data backplane preferably 
comprise an ethemet link, an infiniband link, and a server management link. Network connections 
external to the chassis are established with data cables. That is, switches in different chassis are 
connected using a data cable. In addition, servers in a chassis are connected to a network by 
coupling the switches in those chassis to the network using a data cable as well. Connecting 
servers in different racks is also accomphshed by coupling switches in those racks using a single 
data cable. 

[0012] Each modular server chassis preferably includes a plurality of server slots, each server 
slot configured to accept the server blades. The switches are preferably located on opposite sides 
of the chassis. In the preferred embodiment, each chassis holds 8 servers and two switches and has 
a height equivalent to six standard rack units (U's) or 10.5". In contrast with conventional rack 
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mount server systems, the server and network device slots in the preferred embodiment are vertical 
slots. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0013] For a detailed description of the preferred embodiments of the invention, reference will 
now be made to the accompanying drawings in which: 

[0014] Figure 1 shows a pictorial representation of a computer server rack, server chassis, and 
power chassis in accordance with the preferred embodiment; 

[0001] Figure 2 shows a block diagram of a computer server with which the preferred 
mibodiment may be implemented; 

[0015] Figure 3 shows a block diagram showing the preferred power and data distribution 
scheme within a server rack; 

[0016] Figure 4 is a rear isometric view pf a server rack showing the preferred power bus bar 
and power backplane distribution scheme; 

[0017] Figure 5 shows a diagrammatic rq)resCTtation of the server footprint along with the 
preferred data baclq)lane within the preferred server chassis; 

[0018] Figure 6A shows the preferred point to point network data link within the preferred data 
backplane; 

[0019] Figure 6B shows an alternate embodiment using the preferred point to point network data 
link within the preferred data baclq)lane; and 

[0020] Figure 6C shows yet another alternate embodiment using the preferred point to point 
network data link within the preferred data backplane. 
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NOTATION AND NOMENCLATURE 
[0021] C^tain terms are used throughout the following description and claims to refer to particular 
system componmts. As one skilled in the art will appreciate, computer companies may refer to a 
component by different names. This document does not intend to distinguish between components 
that differ in name but not function. In the following discussion and in the claims, the terms 
'^inpluding" and "comprising" are used in an open-ended fashion, and thus should be interpreted to 
mean "including, but not limited to. . Also, the term "couple" or "couples'' is intended to mean 
either an indirect or direct electrical connection. Thus, if a first device couples to a second device, 
that connection may be through a direct electrical connection, or througji an indirect electrical 
connection via other devices and connections. In addition, the following non-limiting definitions 
are provided to aid in understanding the preferred embodiments of this invention: 
[0022] Rack - a rack is a stmctural system that fomis a frame for mounting other devices therein 
in a rack mounted computa: system. The rack could be as simple as a top, a bottom and four 
comer pieces forming the stmcture, but may also include decorative or fimctional coverings around 
and on those structural components. 

[0023] Chassis - a chassis is a structure, typically smaller than the overall rack, that is mounted 
within the rack. In the preferred anbodiments of the preset invention, individual servers are 
mounted in the rack mounted system by insertion into the chassis structures. A chassis may 
alternatively be referred to as a port or an enclosure. 

[0024] Server - a server is an individual computer moimted within a rack system. Because most 
computers mounted in rack systems perform server-type operations, throughout this discussion 
those devices will be referred to as servers. However, the description herein pertains equally to 
any rack mounted computer system performing server operations or otherwise. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
[0025] Referring now to Figure 1, rack system 100 represents a server rack in accordance with 
the preferred embodiment Rack 100 is preferably configured to accept 19 inch wide rack 
equipment in compliance with EIA width standards and RETMA mounting standards. Rack 100 
preferably comprises various chassis, server, and power supply components as depicted. For 
illustrative purposes, server rack 100 is fitted with hardware comprising different types of servers 
160, 170 and power supphes 180. Power supplies 180 are preferably redundant supplies that 
provide power to servers 160, 170. By way of example, and not by way of limitation, the servers 
shown in Figure 1 include application servers 160 and back-end serv^ 170. Server rack 100 may 
also be fitted with other hardware and in different configurations as will be recognized by those 
skilled in the art. For the purposes of this desaiption of the pref^red embodiment, however, it 
may be assumed that the rack includes servers of the type described ha^ein. AppUcation servers 
160 are preferably designed for less demanding tasks than the back-end servers 170. For example, 
appUcation servers 160 may be used for web and ASP (Application Service Provider) hosting or 
media streaming while back-end servers 170 migjit be used as database servers or as gateways to a 
storage area networic. In general, because of larger processing and storage requiremaits, the back- 
end servers 170 may occupy a larger volume of space than the application serves 160. It should 
also be noted that otiier servers, such as front-end servers (not shown), that may be used for tasks 
such as individual web servers or for dedicated appUcations such as firewalls or for DNS lookup 
may also be included in rack 1 00. 

[0026] Each of the servers 160,- 170 are preferably encased in a modular, removable housing 
called a 'Tjlade*' 190. These blades 190, in tum, are mstalled in a vatical configuration in any of a 
plurality of modular chassis subframes 150 witiiin rack 100. Similarly, tiie power supplies are 
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enclosed in a separate power supply chassis 155. According to the preferred embodiment, the 
server rack 100 preferably includes six server chassis 150 and two power chassis 155. Within any 
server chassis 150, server blades 190 are designed to be fiilly intCTchangeable with one another. 
Thus, if a server goes down and needs to be replaced, the existing blade is simply swapped for a 
new blade. As the blades are inserted into a given chassis, connectors at the rear of the blade 
couple to mating connectors at the rear of the chassis to provide pow^ and data connectivity. The 
blades are preferably locked into place in the chassis with any sxiitable latching hardware such as 
quick-release latches, thumbsarews, or some other type of captive hardware or retaining devices. 
[0027] The blade form factor for application servers 160 may be smaller than for back-end 170 
servers. HowevCT, in accordance with the preferred embodiment, each of these types of server 
blades may be installed in any location within the server rack 100. More specifically, the server 
chassis 150 are preferably configured to accept any type of server 160, 170. Naturally, the size of 
the various types of serves 160, 170 will determine how many of each server will fit in a given 
chassis 150. . 

[0028] Referring now to Fig. 2, a representative server system 200 that may be encased in server 
blade 190 is illustrated. It is noted that many other representative configurations exist and that this 
embodiment is described for illustrative purposes. The server 1 90 of Fig. 2 preferably includes 
multiple CPUs 202 coupled to a bridge logic device 206 via a CPU bus 203. The bridge logic 
device 206 is sometimes referred to as a '"North bridge" for no oth^ reason than it oftra is depicted 
at the upper end of a computer system drawing. The North bridge 206 also preferably comprises a 
memory controller (note shown) to access and control a main memory array 204 via a memory bus 
205. The North bridge 206 couples CPUs 202 and memory 204 to each other and to various 
peripheral devices in the system via one or more high-speed, narrow, source-synchronous 
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expansion buses such as a Fast I/O bus and a Legacy I/O bus. The North bridge 206 can couple 
additional "high-speed narrow" bus links other than those shown in Figure 2 to attach oflier bridge 
devices and other buses such as a PCI-X bus segment to which additional peripherals such as a 
1 Gigabit Ethernet adapts (not shown) may be coupled. The embodiment shown in Figure 2 is not 
intended to limit the scope of possible server architectures. 

[0029] The Fast I/O bus shown m Figure 2 may be coupled to the North bridge 206. In this 
preferred embodiment, the Fast I/O bus attaches an I/O bridge 214 that provides access to a high- 
speed 66Mhz, 64-bit PCI bus segment. A SCSI controller 215 preferably resides on this high 
speed PCI bus and controls multiple fixed disk drives 222. In accordance with the preferred 
embodiment, the disk drives 222 are preferably hot-pluggable firom the fix>nt of rack 100, but may 
alfio be fixed. The hi^ speed PCI bus also provides expansion slots 216 that permit coupling of 
peripheral devices that comply with the high speed PCI bus. 

[0030] The Legacy I/O bus is preferably used to connect legacy peripherals and a primary PCI 
bus via a separate bridge logic device 212. This bridge logic 212 is sometimes referred to as a 
"South bridge" reflecting its location vis-a-vis the North bridge 206 in a typical computer system 
drawing. An example of such bridge logic is described in U.S. Patait No. 5,634,073, assigned to 
Compaq Computer Corporation. The South bridge 212 provides access to the system ROM 213 
and provides a low-pin count ("LPC") bus to legacy peripherals coupled to an I/O controller 226. 
The I/O controller 226 typically interfaces to basic input/output devices such as a floppy disk drive 
228 and, if desired, various other input switches such as a power switch and a suspend switch (not 
shown). The South bridge 212 also may provide one or more expansion buses, but preferably 
provides a 32-bit 33Mhz PCI bus segment on whidi various devices are disposed. It should be 
noted that the Legacy I/O bus may be narrower than other "high speed narrow" buses if it only 
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needs to satisfy the bandwidth requirements of peripherals disposed on the 33Mhz, 32-bit PCI bus 
segment. 

[0031] Various components that comply with the bus protocol of the 33Mh2, 32-bit PCI bus may 
reside on this bus, such as a netwo± interface card CTSflC") 217. The NIC 217 is preferably 
coupled to a network 218 for coromunication with other computers or servers. The NIC 217 may 
be integrated onto the motherboard as presumed by Fig 2, or may be plugged into expansion slots 
210 that are connected to the PCI bus. The network card 217 may conform to any network 
protocol including IP (Internet Protocol) standards such as 10/100 Mbps Ethernet or altematively 
Infiniband (IB) protocols. Furthermore, even though only one NIC 217 is shown m Figure 2, it 
may be desirable to include a second NIC (not shown) for redundancy. 

[0032] Referring still to Figure 2, server 200 preferably also includes an Advanced Server 
Management ("ASM") unit 230 disposed on the 33Mhz, 32-bit PCI bus. According to the 
preferred embodiment, the ASM 230 is a multipurpose management ASIC chip that provides 
various management facilities. The ASM ASIC 230 preferably includes an input/output (I/O) 
processor (not shown) to provide intelligent control of the managmient architecture in the 
server 200. In addition, the ASM 230 also preferably includes one or more out-of-band 
communication interfaces such as a remote or virtual console interface 234 and a power 
management interface 232. These cormnunication interfaces permit out-of-band communication 
with the ASM 230 to enable remote monitoring, control, and detection of various system 
managraient events, including power requirements for the server 200. Thus, in the event of a 
system failure or errors, a system administrator may remotely connect to servCT 200 through the 
virtual console interface 234 to perform a number of tasks including system monitoring and 
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diagaosis. This connection may also allow an administrator to draw up diagnostic progranfxs, 
perform a PXE boot, or perhaps even load an operating system (OS) onto server 200. 
[0033] Referring now to Figure 3, a schematic representation of the powCT and data distribution 
system in server rack 100 is showa In Figure 3, rack 100 includes two power supply chassis 155 
and, in the interest of clarity, two (instead of die preferred six) server chassis 150. According to 
the preferred embodiment, each power supply chassis 155 includes six separate power supplies 300 
capable of converting AC voltage into DC voltage. The DC voltage is transmitted to the rack 
components using a power bus bar scheme described in more detail below. Each server chassis 
150 preferably holds up to 8 individual servers 200 and two networic aggregators, which are 
preferably implemented using ethonet network switches 340. 

[00341 The power distribution system is designed to be completely redundant. That is, the 
power supplies are preferably divided into A and B halves, with each half providing power to each 
component in the rest of the rack 100. This power redundancy is shown in Figure 3, where flie 
power suppUes 300 on the left half of the rack 100 distribute power along the A distribution path 
310 and the power suppUes 300 on the right half of the rack 100 distribute power along the B 
distribution path 320. AC power may be provided to all the power suppUes 300 from a common 
source, but is preferably provided to each half A & B from separate AC supplies for additional 
redundancy. Power from the powCT suppUes 300 are transmitted to each sarver chassis 150 and 
then routed 330 within the chassis to each component within the chassis. During normal 
operations, the components within each chassis 150 preferably operate using power from the A and 
B sides of power suppUes 300, howeva: it must be noted that each half is completely sufficient to 
power the entire rack 100. Thus, if sq)arate AC suppUes are used and one of these AC suppUes 
fails, the rack 1 00 can remain in operation. It should also be noted that while the power supplies in 
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Figure 3 have been split into redundant left and right halves (A & B), redundancy may also be 
obtained by splitting the power supplies into top and bottom halves or some other suitable division. 
Furthermore, it is also possible that more than two subdivisions of the power supplies may be 
implemented for further redundancy. 

[0035] The data transmission paths in rack 100 are represented in Figure 3 by dashed arrows. 
Each server chassis 150 preferably includes switches 340 on both sides of the chassis, hi 
accordance with the preferred embodiment, each switch 340 has point to point data links 350 with 
each server 200 and also preferably includes at least two open connector ports 352. These open 
connector ports 352 in each switch 340 permit cable connections between server chassis 150 or 
external networks. The point to point links 350 as depicted in Figure 3 should not be interpreted to 
mean that servers 200 are interconnected to one another, but rather that each individual server is 
linked to the switches 340 at either end of the chassis 150. The data links are shown in greater 
detail in Figures 6A-6C and discussed below. 

[0036] hi accordance with the preferred rack mount server system, the only data connections 
requiring physical cables are those that are coupled to the connector ports 352 in switches 340. All 
other power or data transmissions 330, 350 take place along a power bus bar, a power backplane 
and a data backplane as shown in Figures 4, 5, and 6A-6C. Data and power connections for each 
individual sorver 200 are provided by connectors within the data and power backplanes. As each 
server is inserted and seated within a server chassis 150, connectors at the rear of the server mate 
with coimectors in the data and powa: backplanes for full coimectivity. Thus, the preferred 
embodiment eliminates most of the cabling required with conventional rack mount severs. The 
ftiU scope of the power and data infrastracture is discussed below. 
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[0037] Referring now to Figure 4, an isometric view of the rear of server rack 100 is showiL In 
Figure 4, sctvcts 200 and data backplanes are omitted for clarity. Instead, only the power supplies 
300, server chassis 150 and powCT bus infrastructure are shown. The preferred power distribution 
scheme uses a vertical bus bar 400 to transmit power from the power suppUes to the remainder of 
the racL In accordance with the preferred embodiment, the power suppUes convert AC voltage 
from an external source and transmit 48 VDC at 400 amps to the bus bar 400. From the bus bar 
400, a power backplane 410 attached to each server chassis 150 taps power from the bus bar 400. 
As discussed above, the power distribution scheme is redundant and therefore, tiie bus bar 400 
transmits DC voltage from the A & B halves of the power supply along separate voltage supply 
lines. Each power backplane 410 is ftra coupled to the A & B voltage lines in the bus bar 400. 
The power backplane 410, which is preferably manufactured of printed circuit board materials, 
transfers DC voltage from each voltage line (A & B) to each server slot in server chassis 150. In 
Figure 4, the power termination for each server slot is shown as a single coimector 420, but 
separate connectors for the A & B voltage sources may also be implemented. Furthermore, in 
addition to powaing servers 200, the power backplane also includes connectors to provide power 
to switches 340. 

[0038] The power backplanes 410 are predominantiy passive in that they simply transmit voltage 
from source (power bus bar 400) to destination (slot coimectors 420). However, the power 
backplanes 410 may also be manufactured with electronic ftises or breakers (not specifically 
shown) for each voltage transmission line in the backplane. Fuses such as these opiate to isolate 
voltage and current surges and may advantageotisly prevent electronics damage to servers 200 
and/or power supplies 300 caiised by shorts in any single server. 
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[0039] Referring now to Figure 5, the footprint for a single server chassis 150 is shown. In 
accordance with the preferred embodiment, each chassis is installable in an EIA standard 19" wide 
rack and has a 6U height. That is, each chassis has a height of 10.5*\ Each chassis 150 preferably 
holds two switches 340 and has slots to hold eight lU wide server blades 500* It should be noted 
that in contrast to conventional rack mount servers, which are installed horizontally into a rack, the 
server blades 190 that are inserted into each server chassis 150 are predominantly vertical. This 
form factor for lU wide server blades 500 permits a front faceplate that fits at least two hot-plug 
hard drives (not shown) that may be removed from the front of a server without the need to remove 
the entire server. 

[0040] As discussed above, serva:s are designed to perform different tasks and, depending on the 
storage or processing capacity required, the size of the servers may differ. The preferred server 
chassis design described herein is configured to accept servers of various widths. For instance, in 
Figure 6, the center block shows that the preferred server chassis footprint readily accepts a lU 
wide server blade 500, a 2U wide server blade, or any general server blade whose width is some 
integer multiple of the standard U dimension (1.75"). Added together, the sum of the U widths of 
the servers in the preferred chassis cannot exceed eight, although smaller numbers are certainly 
permissible. Thus, in the example provided in Figure 6, server blade 520 is the equivalent of a 5U 
wide server blade and fits in a chassis with server blades 500, 5 1 0 and switches 340. 
[0041] The data transmission infrastructure uses a data backplane 550 associated with each 
SCTver chassis 150. In conjunction with the standard server chassis footprint, the data backplane 
includes connectors for each of the eight server slots 570 and the two switches 560. As with the 
power baclq)lane 410, the data backplane 550 is preferably manufactured from printed circuit 
board materials and the connectors are preferably VHDM (very high density metric) connectors. 
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Mating connectors 580 are accessible fix)m the rear of the servers 500, 510, 520 and switches 340 
installed in the server chassis 150. Once installed, the matmg connectors 580 in the server couple 
with the data backplane connectors thus providing fixll network connectivity in a matter of seconds. 
For servers that occupy more than one slot in the servar chassis 150, the server may conceivably 
only use one mating connector on the backplane 550, th^eby leaving some of the backplane 
connectors 570 unused. Naturally, those skilled in the art will recognized tihat many backplane 
material and connector configurations are certainly possible. Further, it is also possible that 
multiple connectors may be used for each chassis slot provided fliat mating connectors are properly 
positioned on the server blades. 

[0042] The data baclq)lanes 550 preferably include traces creating the point to point Unks 350 
between each server 200 and each switch 340 in a chassis 150 as discussed above in conjunction 
with Figure 3. More specifically, the data backplane provides redundant data transmission lines 
bom each server connector 570 to each switch connector 560. The specific data lines are shown 
more clearly in Figure 6A, which shows the prefrared data transmission links. In the preferred 
embodiment, a server connector 570 for one server slot is shown, but identical data transmission 
lines are built into the data backplane for every server slot Thus, the rCTiaining server connectors 
are omitted fi"om Figure 6A for clarity. 

[0043] In accordance with the preferred embodiment, each server connector 570 is coupled to 
six different signal traces. These signal traces include redundant copies of three distinct data links: 
an internet protocol (DP) link, an infiniband (IB) link, and a virtual console (VC) link, all discussed 
above in conjxmction with tiie representative server of Figure 2. The IP link may be a 10 Mbps, 
100 Mbps, or IGig ethemet network. The VC Unk is also preferably an ethemet Unk while the IB 
link is preferably a IX (single differential pair) infiniband link. Figure 6 A also shows the two 
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connector ports 352 discussed above. In the prefexed embodiment, the switches 340 are ethemet 
switches and, therefore, information forwarded along the IP and VC ethemet lines are forwardable 
via the connector ports 352. The IB links are included for future expandability and are intended to 
be used with IB switches as shown in Figure 6C. 

[0044] A distinct feature of the preferred infrastructure is that the power and data components 
are modular and therefore exchangeable and upgradable. For instance, in Figure 6B, switches 340 
are replaced with simple ethemet pass through devices 600 that merely forward data received along 
each of the ethemet links received at tiie data baclq)lane connectors 560. As such, instead of two 
ethemet output ports 352 as shown in Figure 6A, a plurality of IP or ethemet signals are 
transmitted along by ttie pass through devices 600. 

[0045] Figure 6C shows a similar example wherein the switches 340 are replaced with 
infiniband switches. In this scenario, the switches are capable of handling both IP and IB data and, 
as such, the ou^ut from these switches include a combination of IP and IB ports. This alternative 
configuration may advantageoxisly accommodate a 4X (4 differential pair) IB uplink and downlink 
connections as well as IP connections at each IB switch. As such, the preferred embodiment may 
advantageously provide access to storage area networks and other networks that comply with the 
infiniband connectivity protocol. 

[0046] In each of the examples 6A-6C, the external connection ports preferably provide a way to 
connect each of the serves within that chassis. The redundancy built into this infiBstructure 
provides less reliance on a single data aggregator or network device, whether it be the preferred 
switch, a network hub, or a pass through device. In the prefOTed anbodiment, switch 340 has two 
connector ports 352 that pera^t multiple server chassis 150 to be coupled. Servers in different 
racks 100 may be coupled by connecting switches 340 fix)m each rack with a single cable. Within 
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a rack, switches may be daisy chained together to form a larger network. Given that switches in 
adjacent searver chassis are in close proximity to one another, the cables that are used to daisy chain 
the switches are short in length. Consequently, cable quantities and weight are significantly 
reduced over convention server racks. Thus, the preferred embodiment eliminates most of the 
cabling required in conventional rack mount server systems while at the same time providing a 
flexible infi^tructure for areating a user-configured network. 

[0047] The end result of these advantages is that the improved server infirastmcture reduces the 
amoxmt of time needed to dq)loy a rack of servers. In addition, when a server fails, server 
downtime is reduced because a server can be removed and installed in a matter of seconds. 
Furthermore, the preferred embodiment provides redundant power and data pathways for high 
reliability. The above discussion is meant to be illustrative of the principles and various 
embodiments of the present invention. Numeroiis variations and modifications will become 
apparent to those skilled in the art once the above disclosure is fiilly appreciated. It is intended that 
the following clairos be interpreted to embrace all such variations and modifications. 
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CLAIMS 

What is claimed is: 

1 1. . A computer server rack, comprising: 

2 a plurality of modular server chassis, each chassis configured to hold a plurality of servers 

3 and at least one data aggregator coupled to each server in the same chassis via a point to point link; 

4 at least one group of AC to DC power suppUes; 

5 a power bus bar configured to transmit power from the power suppUes to a power 

6 backplane in each scrv^ chassis; 

7 wherein DC power is provided to each server in the rack through the power bus bar and the 

8 power backplane located in the same chassis. 

1 2. The computer server rack of claim 1 fiirfher comprising: 

2 a second group of AC to DC power suppUes configured to transmit power to the power 

3 backplane in each server chassis through the power bus bar; 

4 wherein DC power from both the first and tiie second groups of AC to DC power supplies 

5 is provided to each server in the rack through the power bus bar and the power backplane located 

6 in the same chassis. 

1 3. The computer server rack of claim 2 wherein servers in a chassis are coupled to a network 

2 by coupling the aggregator in the same rack to the network. 



1 4. The computer server rack of claim 3 wherein the aggregator is an EP network switch. 
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1 5. The cx)mputer server rack of claim 3 wherein the aggregator is an Infiniband network 

2 switch. 

1 6. The computer server rack of claim 3 wherein each server chassis further comprises: 

2 a second aggregator coupled to each server in the same chassis via a redundant copy of the 

3 point to point link betweei the first aggregator and each server in the same chassis. 

17. An method for providing data and power connectivity to a plurality of rack mount servers 

2 comprising: 

3 housing each server in a chassis; 

4 housing a first network switch in each chassis; 

5 coupling the first switch to each server in the same chassis with a point to point network 

6 link; 

7 housing a pluraUty of chassis in a rack; 

8 hoiising a plurality of powa: si^plies in the rack; 

9 transmitting power firom the power supplies to a power bus bar; 

1 0 transmitting power fix)m the power bus bar to each chassis; and 

1 1 connecting servers in separate chassis to the same network by coupling the switches in 

12 those chassis to one another. 

1 8. The method of claim 7 further comprising: 

2 housing a second network switdi in each chassis; and 
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3 coupling the secx>nd switch to each strvec in the chassis with the same point to point 

4 network link as between each server in the chassis and the first network link. 



1 9. The method of claim 8 fiirflier comprising: 

2 enclosing each server in a blade enclosure. 

1 10. The method of claim 9 further comprising: 

2 subdividing the power supplies into at least two groups; 

3 transmitting power firom each group of power supplies to a separate power transmission 

4 line in the bus bar, 

5 transmitting power firom each power transmission line to each server and switch in each 

6 chassis throu^ a power baclq)lane at the rear of each chassis. 

1 11. The method of claim 9 fiirther comprising: 

2 coupling a powa: connector at the rear of each server blade enclosure with a mating power 

3 connector on the power backplane; 

1 1 2. The method of claim 9, further comprising: 

2 encapsulating the point to point links in a data backplane; and 

3 coupling a data connector at the rear of each servo: blade enclosure with a mating server 

4 data connector on the data backplane. 



1 13. The method of claim 1 2, further comprising: 
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2 coupling a switch connector at the rear of the switches with a mating switch data connector 

3 on the data backplane; and 

4 coupling the switches in sq)arate chassis using a data cable. 

1 14. The method of claim?, fijTther comprising: 

2 connecting servers in different racks by coupling switches in those racks using a single data 

3 cable. 

1 1 5. The method of claim 7, fijrther comprising: 

2 connecting servers in a chassis to a network by coupling the switches in those chassis to flie 

3 network. 

1 16. A modular server chassis installable in a rack and configured to hold a plurality of servers 

2 comprising: 

3 a plurality of saver slots, each server slot configured to accept a server encased in a server 

4 blade; 

5 a plurality of network device slots, each network device slot configured to accept a network 

6 device; 

7 a data backplane; and 

8 a power backplane; 

9 wherein network comiectivity for each server is provided through point to point links in the 
1 0 data backplane between each server slot and each network device slot 
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1 17. The server chassis of claim 16 wherein the server and network device slots are vertical 

2 . slots. 

1 18. The server chassis of claim 1 6 wherein; 

2 the power backplane is configured to transmit power from a plurality of redundant power 

3 supplies to each server and network device slot. 

1 1 9. The server chassis of claim 1 8 wh^ein; 

2 the power backplane further comprises a fuse between the power supply and each device 

3 slot. 



1 20. The server chassis of claim 1 8 wherein; 

2 the power backplane further comprises a VHDM connector for each server slot and each 

3 network device slot configured to mate with a mating connector on the server blades and network 

4 devices to transmit power to the server blades and network devices. 



1 21. The server chassis of claim 16 wherein the point to point links in the data backplane 

2 comprise: 

3 an ethemet link; 

4 an infiniband link; and 

5 a server management link. 



1 



22. The server chassis of claim 2 1 wherein; 
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2 the data backplane further comprises a VHDM connector for each server slot and network 

3 device slot configured to mate with a mating connector on the server blades and network devices to 

4 transmit signals along the point to point links between the server blades and network devices. 

1 23. The server chassis of claim 1 7 wherein the server chassis holds 8 server blades, each blade 

2 having a 1 U width and two switches. 

1 24. The server chassis of claim 23 wherein the server chassis has a 6U vertical height 
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ABSTRACT 

A modular infrastructure for a cx)mputer server rack, comprising modular server chassis, 
each chassis configured to receive a plurality of servers and two network switches. The switches 
are redundantly coupled to each server in the same chassis via point to point links within a data 
5 backplane. The rack further comprises redundant AC to DC power suppUes configured to transmit 
power to a power backplane in eadi of the server chassis through a power bus bar. DC power is 
provided by both power suppHes to each server in the rack through the power bus bar and a power 
backplane located m the same chassis. Each power supply is sufficient to power the entire rack. 
Servers within separate chassis are coupled into the same network by merely daisy chaining the 
10 switches in the rack. Individual servers are deployed by sUding the servers into a server chassis to 
engage cormectors in the backplanes. 
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Colleen Brown 



From: Andrew Aranda 

Sent: Friday, October 1 2, 2001 1 :08 PM 

To: Colleen Brown 

Subject: RE: COMPAQ 1662-39800 



yeah, last week, he was calling from his hospital bed. i told him we can get together whenever he feels well enough to 
discuss this and 39100 

— Origlna! Message — 
From: Colleen Brown 

Sent: Friday, October 12, 2001 1:04 PM 

To: Andrew Aranda 

Subject: l=W: COMPAQ 1662-39800 

Have you heard from the inventors? 
« Message: COMPAQ 1662-39800 » 



1 



Colleen Brown 



From: Andrew Aranda 

Sent: Tuesday, September 25. 2001 10:06 AM 

To: Jon Harris 

Cc: Colleen Brown 

Subject: RE: ISSG STATUS CHART_v3.DOC 



398 - 1 sent a second draft to the inventors last Tuesday. I emailed a reminder Thursday and phoned yesterday and 
indicated that if I didn't hear from them, we*d initiate the paperwork. I think we can proceed with formals at this point. But 
see about Mike Sanders below. 

391 , 392 - Mike Sanders is the only inventor on these two and he's been working from home post-surgery. At the 
beginnnig of the month, he indicated he'd be available to review and sign, but he hasn't returned my emails or phone calls 
for about a week and a half. He has still not given any feedback on the first draft of either of these. 

— Original Message — 



From: Jon Harris 

Sent: Tuesday, September 25, 2001 9:22 AM 

To: Andrew Aranda; Gene C. Vallow; Collin A. Rose 

Cc: Colleen Brown 

Subject: RE: ISSG STATUS CHART_v3,D0C 



Of the 17 server-related cases we told CPQ we'd file this quarter, which ends Friday, 12 have either been filed or are 
out with CPQ Legal awaiting inventor signatures. The remaining 5 still have not gotten to the point where we can send 
them out for formal doc signatures. Not to sound like a broken record, but please do whatever you can to expedite the 
process. Call or email the inventors and tactfully and gently encourage them to review the applications today or 
tomorrow if possible. Please advise 

38700 - Collin, your initial draft of this is going out today. Please call Ken Baker and see if he has time to review it. 
Since this is an 1 1th hour sort of deal 

391 , 392, 398 - Andrew - see where the inventors are reviewing these cases. 

41300 - Gene, tell Al if the case is ready to send it over so Colleen can send it out for formal docs 

Colleen - Please ask Paul Olarig to at least sign and fax his declarations this week. Let me know if there are any 
other ex employees who haven't signed yet. Also, please make sending out any initial drafts and formal docs a top 
priority. 

If I can be of any assistance to anyone, please advise. 

If a case has to be pushed to Q4, it's certainly not the end of the world (keeping mind any bar dates of course). 
However, it's much much better if we can file cases when we tell CPQ we're going to. 

Jon 

— Original Message 

From: Jon Harris 

Sent: Tuesday, September 04, 2001 2:46 PM 

To: Andrew Aranda; Mark E. Scott; Gene C Vallow 

Cc: Michael Helm 

Subject: ISSG STATUS CHART_v3.DOC 

Gentlemen- 
Here's the chart I sent to CPQ. Please do your very best to live and die by the Q3 filings we've now told CPQ. If 
you anticipate being hit by a bus in the next few weeks, please make sure someone else can continue your work. 
(I include myself In this as well) 

Fondly, 
Jon 

« File: ISSG STATUS CHART_v3.DOC » 
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